Adapting interactions with a television user

ABSTRACT

Implementations generally relate to adapting interactions with a television user. In some implementations, a method includes interacting with a user based on a first behavior pattern, wherein the first behavior pattern includes one or more predetermined behaviors. The method further includes observing one or more responses from the user, wherein the one or more responses are responsive to the one or more predetermined behaviors. The method further includes modifying at least one of the predetermined behaviors, wherein the modifying of the results in at least one modified behavior. The method further includes observing at least one change in one or more of the responses, wherein the at least one change is responsive to the at least one modified behavior. The method further includes interacting with the user based on a second behavior pattern, wherein the second behavior pattern includes one or more of the predetermined behaviors and the modified behavior.

CROSS REFERENCES TO RELATED APPLICATIONS

This application is a continuation of the following application, U.S.patent application Ser. No. 16/055,795, entitled ADAPTING INTERACTIONSWITH A TELEVISION USER, filed on Aug. 6, 2018(020699-112600US/SYP328331US02), which is hereby incorporated byreference as if set forth in full in this application for all purposes.

BACKGROUND

Devices are increasingly using voice agents to interact with users. Thecurrent generation of voice agents are devoid of personality, and can beperceived to be emotionless or robotic to the user (e.g., lacking anyemotion or feeling of empathy). While this does not affect theusefulness, it can make the experience awkward. Attempting to create anagent with personality has shortcomings because each person has adifferent preference and tolerance for particular personality traits.Conventional voice agents often create an awkward and undesirable userexperience.

SUMMARY

Implementations generally relate to adapting interactions with atelevision user. In some implementations, a system includes one or moreprocessors, and includes logic encoded in one or more non-transitorycomputer-readable storage media for execution by the one or moreprocessors. When executed, the logic is operable to perform operationsincluding interacting with a user based on a first behavior pattern,wherein the first behavior pattern includes one or more predeterminedbehaviors; observing one or more responses from the user, wherein theone or more responses are responsive to the one or more predeterminedbehaviors; modifying at least one of the predetermined behaviors,wherein the modifying of the results in at least one modified behavior;observing at least one change in one or more of the responses, whereinthe at least one change is responsive to the at least one modifiedbehavior; and interacting with the user based on a second behaviorpattern, wherein the second behavior pattern includes one or more of thepredetermined behaviors and the modified behavior.

With further regard to the system, in some implementations, at least oneof the predetermined behaviors includes communicating with the user byvoice. In some implementations, the at least one modified behaviorincludes conveying affects to the user. In some implementations, tomodify at least one of the predetermined behaviors, the logic whenexecuted is further operable to perform operations comprising modifyingone or more voice characteristics. In some implementations, the at leastone change in one or more of the responses comprises a positive reactionor a negative reaction. In some implementations, the logic when executedis further operable to perform operations comprising: detecting anotification to be delivered to the user; detecting when a commercial isbeing shown on a television; and delivering the notification to the userduring the commercial. In some implementations, the logic when executedis further operable to perform operations comprising: determining anidentity of the user; and presenting to the user a predetermined userinterface that is associated with the user.

In some embodiments, a non-transitory computer-readable storage mediumwith program instructions thereon is provided. When executed by one ormore processors, the instructions are operable to perform operationsincluding interacting with a user based on a first behavior pattern,wherein the first behavior pattern includes one or more predeterminedbehaviors; observing one or more responses from the user, wherein theone or more responses are responsive to the one or more predeterminedbehaviors; modifying at least one of the predetermined behaviors,wherein the modifying of the results in at least one modified behavior;observing at least one change in one or more of the responses, whereinthe at least one change is responsive to the at least one modifiedbehavior; and interacting with the user based on a second behaviorpattern, wherein the second behavior pattern includes one or more of thepredetermined behaviors and the modified behavior.

With further regard to the computer-readable storage medium, in someimplementations, at least one of the predetermined behaviors includescommunicating with the user by voice. In some implementations, the atleast one modified behavior includes conveying affects to the user. Insome implementations, to modify at least one of the predeterminedbehaviors, the instructions when executed are further operable toperform operations comprising modifying one or more voicecharacteristics. In some implementations, the at least one change in oneor more of the responses comprises a positive reaction or a negativereaction. In some implementations, the instructions when executed arefurther operable to perform operations comprising: detecting anotification to be delivered to the user; detecting when a commercial isbeing shown on a television; and delivering the notification to the userduring the commercial. In some implementations, the instructions whenexecuted are further operable to perform operations comprising:determining an identity of the user; and presenting to the user apredetermined user interface that is associated with the user.

In some implementations, a method includes interacting with a user basedon a first behavior pattern, wherein the first behavior pattern includesone or more predetermined behaviors; observing one or more responsesfrom the user, wherein the one or more responses are responsive to theone or more predetermined behaviors; modifying at least one of thepredetermined behaviors, wherein the modifying of the results in atleast one modified behavior; observing at least one change in one ormore of the responses, wherein the at least one change is responsive tothe at least one modified behavior; and interacting with the user basedon a second behavior pattern, wherein the second behavior patternincludes one or more of the predetermined behaviors and the modifiedbehavior.

With further regard to the method, in some implementations, at least oneof the predetermined behaviors includes communicating with the user byvoice. In some implementations, the at least one modified behaviorincludes conveying affects to the user. In some implementations, tomodify at least one of the predetermined behaviors, the method furthercomprises modifying one or more voice characteristics. In someimplementations, the at least one change in one or more of the responsescomprises a positive reaction or a negative reaction. In someimplementations, the method further comprises: detecting a notificationto be delivered to the user; detecting when a commercial is being shownon a television; and delivering the notification to the user during thecommercial.

A further understanding of the nature and the advantages of particularimplementations disclosed herein may be realized by reference of theremaining portions of the specification and the attached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a block diagram of an example television environment,which may be used for some implementations described herein.

FIG. 2 illustrates an example flow diagram for adapting interactionswith a television user, according to some implementations.

FIG. 3 illustrates an example flow diagram for adapting interactionswith a television user, according to some implementations.

FIG. 4 illustrates an example flow diagram for adapting interactionswith a television user, according to some implementations.

FIG. 5 illustrates a block diagram of an example television environment,which may be used for some implementations described herein.

FIG. 6 illustrates a block diagram of an example television environment,which may be used for some implementations described herein.

FIG. 7 illustrates a block diagram of an example computing system 700,which may be used for some implementations described herein.

DETAILED DESCRIPTION

Implementations described herein adapt interactions with a televisionuser. In various implementations, a system interacts with a user basedon a first behavior pattern, which includes one or more predeterminedbehaviors. The system observes responses from the user, where theresponses are responsive to the predetermined behaviors. As described inmore detail herein, the system modifies one or more of the predeterminedbehaviors, which results in modified behaviors. The system observes ifthere are any changes in the user's responses, wherein the changes areresponsive to the modified behaviors. The system continues interactingwith the user based on a second behavior pattern, which includes one ormore of the predetermined behaviors and the modified behavior.

FIG. 1 illustrates a block diagram of an example television environment100, which may be used for some implementations described herein. Insome implementations, television environment 100 includes a television102, which interacts with a user 104. Television 102 interacts with user104 based on behavior patterns. For example, television 102 may interactwith user 104 based on a first behavior pattern (labeled BehaviorPattern 1), which may elicit a response from user 104. Television 102may modify one or more behaviors, which in turn may elicit a responsefrom user 104. In various implementations, television 102 may resumeinteracting with user 104 with a second behavior pattern (labeledBehavior Pattern 2), which includes at least some of the behaviors ofthe first behavior pattern and the modified behavior pattern. Exampleimplementations are described in more detail herein.

In various implementations, television 102 includes a voice agent forinteracting with the user. Television 102 also incudes a built-inmicrophone and a built-in camera. As such, when the user makes differentkinds of requests, television 102 may observe the user's facialexpressions and see how the user responds. In various implementations,television 102 may use machine learning techniques in order to determineif particular communication styles are successful or not.

For ease of illustration, FIG. 1 shows one block for television 102.Block 102 may represent multiple systems and/or devices. In otherimplementations, television 102 may not have all of the components shownand/or may have other elements including other types of elements insteadof, or in addition to, those shown herein. Television 102 may performthe implementations described herein alone or in combination with otherdevices. In various implementations, the system may stored unique userprofiles for each user of multiple users.

FIG. 2 illustrates an example flow diagram for adapting interactionswith a television user, according to some implementations. Referring toboth FIGS. 1 and 2, a method is initiated at block 202, where the systemsuch as television 102 interacts with a user based on a first behaviorpattern, wherein the first behavior pattern includes one or morepredetermined behaviors. In various implementations described herein thesystem interacts by sounds such as by voice or with music or othersounds. In various implementations, a predetermined behavior may includecommunicating with the user by voice. In some implementations, apredetermined behavior may include providing particular information tothe user (e.g., movie recommendations, etc.).

The predetermined behaviors may vary depending on the implementation.The system may use varying voice tones (e.g., high, low, cheery or calm,etc.), speed, level of engagement (e.g., proactive or passive; longanswers or short answers, etc.) and other factors to build engagement.For example, the system when communicating by voice may speak withhigher volume or lower volume. The system may speak more quickly or moreslowly. The system may use a smooth voice or a less smooth voice, etc.The system may use a male voice, female voice, etc.

At block 204, the system observes one or more responses from the user,wherein the one or more responses are responsive to the one or morepredetermined behaviors. For example, the system may observe facialexpressions. The system may determine using facial and/or patternrecognition if the user is happy or unhappy, or confused.

At block 206, the system modifies at least one of the predeterminedbehaviors, wherein the modifying results in at least one modifiedbehavior. In various implementations, the system modifies at least oneof the predetermined behaviors by modifying one or more voicecharacteristics. For example, the system may communicate with the userwith more volume and more slowly. Alternatively, the system maycommunicate in a more curt, direct, to the point manner. Such variationsmay range from subtle to overt.

In various implementations, a modified behavior includes conveyingaffects to the user. For example, the system may play background music(e.g., mood music, etc.) or may make particular sounds (e.g., beeps,etc.). In another example, the system may convey affects includingmusic, sound, lights, or pictures. Such content may be retrieved from adatabase of appropriate effects.

In some implementations, when the user queries the system, the systemmay provide selected music and/or sounds and lights conforming to thegeneral mood of the query (e.g., happy, sad, etc.). With a receptiveresponse from the user the agent confirms the diagnosis of constructiveuser responses and takes the next appropriate interaction with the user.

In some implementations, the system may convey visual cues along withaudio cues. Such cues may include, for example, colors, photos, videos,or even an avatar of the system with the capacity to show emotion to theuser. These may be informed by user television viewing preferences.

At block 208, the system observes at least one change in one or more ofthe responses, wherein the at least one change is responsive to the atleast one modified behavior. The system assess the success of differentmodifications by observing resulting responses from the user. In variousimplementations, at least one change in one or more of the responsescomprises a positive reaction or a negative reaction. For example, ifthe user shows a positive change such as smiling more, or becoming moreinteractive, the system would log the positive change in the user'sresponses. In contrast, if the user shows a negative changes such assmiling less, or becoming less interactive, the system would log thenegative change in the user's responses.

In various implementations, the responses or feedback from the user maybe implicit or explicit. For example, in some implementations, thesystem may look for facial expressions. In some implementations, thesystem may receive explicit feedback from user indicating that the userlikes or does not like particular modified behavior from the system. Thesystem may continuously alter its interaction mode as needed or tooptimize interaction with the user.

In some implementations, the system may introduce other predeterminedbehavior. For an example, the system may proactively inform the user ofupcoming sports events or a movie schedule. In response, the user mightexplicitly expresses positive or negative feedback (e.g., “Keepnotifying me of sports events.” or “I'm not interested.” etc.). Or, theuser may behave in a way that implies positive or negative reaction. Forexample, the user might actively use the information to schedule a TVrecording, or user might sound unenthusiastic or annoyed whenresponding, etc. The system logs these responses, and, over time, formsan appropriate level of “proactiveness” that is appropriate for theparticular user.

At block 210, the system interacts with the user based on a secondbehavior pattern, wherein the second behavior pattern includes one ormore of the predetermined behaviors and the modified behavior. Overtime, the personality that the system conveys evolves and adapts to eachuser.

Such emotional or empathetic interaction to a user's query conveys adeeper sense of understanding by the system and greatly enhances theuser experience. Implementations may provide non-verbal communicationwhen appropriate, which may result in a greater trust and bonding withthe system.

Although the steps, operations, or computations may be presented in aspecific order, the order may be changed in particular implementations.Other orderings of the steps are possible, depending on the particularimplementation. In some particular implementations, multiple steps shownas sequential in this specification may be performed at the same time.Also, some implementations may not have all of the steps shown and/ormay have other steps instead of, or in addition to, those shown herein.

FIG. 3 illustrates an example flow diagram for adapting interactionswith a television user, according to some implementations. Referring toboth FIGS. 1 and 3, a method is initiated at block 302, where the systemdetects a notification to be delivered to the user.

At block 304, the system detects when a commercial is being shown on atelevision. The system may detect commercials based on volume changes,black frames, set times, etc.

At block 306, the system delivers the notification to the user duringthe commercial. As a result, the system avoids unwanted interruptionswhile the user is enjoying television content. This allows the user toenjoy television with minimal interruptions (e.g., pop-up notifications)while the user is watching their primary content. This enhances theviewing experience.

In some implementations, the system may prioritize notifications. Thesystem may deliver some predetermined notifications during the primarycontent. For example, the system may deliver a notification from a smartdoorbell (e.g., pizza delivery, etc.) or from a particular person (e.g.,family member, etc.).

Although the steps, operations, or computations may be presented in aspecific order, the order may be changed in particular implementations.Other orderings of the steps are possible, depending on the particularimplementation. In some particular implementations, multiple steps shownas sequential in this specification may be performed at the same time.Also, some implementations may not have all of the steps shown and/ormay have other steps instead of, or in addition to, those shown herein.

FIG. 4 illustrates an example flow diagram for adapting interactionswith a television user, according to some implementations. As describedin more detail herein, implementations optimize interaction for thespecific user. Referring to both FIGS. 1 and 4, a method is initiated atblock 402, where the system determines the identity of the user. Thesystem may use a built-in camera and facial recognition, and a built-inmic and voice recognition to detect who is using the television. Thesystem may also determine a usage signature of the user (e.g., method ofoperation such as remote control, voice, phone control, etc.).

At block 404, the system determines a predetermined user interface thatis associated with the user. The system switches to a profile of theparticular user and sub-profile (e.g., current control method), whichcarries some associated information about which user interface (UI)patterns and settings are preferred for that user.

The system may access a library of different UI patterns to be used forvarious situations. Each pattern may be given a priority. In someimplementations the system collects all the available factors (e.g.,person, ability level, control method, etc.) and weighs those factors.The system then selects the best UI pattern for the situation. The usermay also manually enter settings and select some priority levels orpatterns that the user prefers.

In some implementations, the system may store and access a user'sviewing preferences in order to help the system determine or suggestparticular UI settings. For example, a user who has a preference forwatching sporting might want notifications of upcoming sporting events.A user who has a preference for music programs might want backgroundmusic to be played with some user interfaces.

At block 406, the system presents to the user the predetermined userinterface that is associated with the user. A system seamlessly andautomatically switches between different UI patterns and settings basedon who is operating the television. For example, the system adapts tousers with specific preferences (e.g., easy controls for younger users,etc.) and/or impairments (e.g., vision, hearing, mobility, etc.).

Implementations allow users to operate the television in the best wayfor them without actively hunting through settings for particularcontrols. Implementations also encourage smoother operation of voice bydisplaying voice UI on the first attempt to use it. In multi-personhouseholds, the system automatically switches between optimal methods,giving each user a highly personalized experience.

In some implementations, the system modifies the controls of to theaccess capability/limitations of the user by identifying the user. Thesystem accesses the user's access/capability/limitation profile, andidentifies the appropriate UI for the user. For example, a user withblindness may need the television to have a screen reader function) orhave voice-over enabled. The system may automatically turn such featureson for that user, and may turn those features off for other users. Inanother example, the system may speak in a particular languageassociated with the user.

Although the steps, operations, or computations may be presented in aspecific order, the order may be changed in particular implementations.Other orderings of the steps are possible, depending on the particularimplementation. In some particular implementations, multiple steps shownas sequential in this specification may be performed at the same time.Also, some implementations may not have all of the steps shown and/ormay have other steps instead of, or in addition to, those shown herein.

FIG. 5 illustrates a block diagram of an example television environment500, which may be used for some implementations described herein. Shownis a television 502 and a user 504 interacting with television 502. Inthis example scenario, when the system recognizes user 504 with a camera506, the system displays a UI 508 that is appropriate for user 504. UI508 is a menu-style UI pattern that is preferred by user 504.

In some implementations, the system accesses a library of different UIs,which may be stored by the system or accessed in the cloud. For example,the library may include traditional menu UIs, graphical UIs, etc.

FIG. 6 illustrates a block diagram of an example television environment600, which may be used for some implementations described herein. Shownis the same television 502 as in FIG. 5, and a different user 604interacting with television 502. In this example scenario, when thesystem recognizes user 604 with a camera 506, the system displays a UI608 that is appropriate for user 504. UI 508 is a graphical-style UIpattern that is preferred by user 604.

FIG. 7 illustrates a block diagram of an example computing system 700,which may be used for some implementations described herein. Forexample, computing system 700 may be used to implement television 102 ofFIG. 1, as well as to perform implementations described herein. In someimplementations, computing system 700 may include a processor 702, anoperating system 704, a memory 706, and an input/output (I/O) interface708. In various implementations, processor 702 may be used to implementvarious functions and features described herein, as well as to performthe method implementations described herein. While processor 702 isdescribed as performing implementations described herein, any suitablecomponent or combination of components of computing system 700 or anysuitable processor or processors associated with computing system 700 orany suitable system may perform the steps described. Implementationsdescribed herein may be carried out on a user device, on a server, or acombination of both.

Computing system 700 also includes a software application 710, which maybe stored on memory 706 or on any other suitable storage location orcomputer-readable medium. Software application 710 provides instructionsthat enable processor 702 to perform the implementations describedherein and other functions. Software application may also include anengine such as a network engine for performing various functionsassociated with one or more networks and network communications. Thecomponents of computing system 700 may be implemented by one or moreprocessors or any combination of hardware devices, as well as anycombination of hardware, software, firmware, etc.

For ease of illustration, FIG. 7 shows one block for each of processor702, operating system 704, memory 706, I/O interface 708, and softwareapplication 710. These blocks 702, 704, 706, 708, and 710 may representmultiple processors, operating systems, memories, I/O interfaces, andsoftware applications. In various implementations, computing system 700may not have all of the components shown and/or may have other elementsincluding other types of components instead of, or in addition to, thoseshown herein.

Although the description has been described with respect to particularembodiments thereof, these particular embodiments are merelyillustrative, and not restrictive. Concepts illustrated in the examplesmay be applied to other examples and implementations.

In various implementations, software is encoded in one or morenon-transitory computer-readable media for execution by one or moreprocessors. The software when executed by one or more processors isoperable to perform the implementations described herein and otherfunctions.

Any suitable programming language can be used to implement the routinesof particular embodiments including C, C++, Java, assembly language,etc. Different programming techniques can be employed such as proceduralor object oriented. The routines can execute on a single processingdevice or multiple processors. Although the steps, operations, orcomputations may be presented in a specific order, this order may bechanged in different particular embodiments. In some particularembodiments, multiple steps shown as sequential in this specificationcan be performed at the same time.

Particular embodiments may be implemented in a non-transitorycomputer-readable storage medium (also referred to as a machine-readablestorage medium) for use by or in connection with the instructionexecution system, apparatus, or device. Particular embodiments can beimplemented in the form of control logic in software or hardware or acombination of both. The control logic when executed by one or moreprocessors is operable to perform the implementations described hereinand other functions. For example, a tangible medium such as a hardwarestorage device can be used to store the control logic, which can includeexecutable instructions.

Particular embodiments may be implemented by using a programmablegeneral purpose digital computer, and/or by using application specificintegrated circuits, programmable logic devices, field programmable gatearrays, optical, chemical, biological, quantum or nanoengineeredsystems, components and mechanisms. In general, the functions ofparticular embodiments can be achieved by any means as is known in theart. Distributed, networked systems, components, and/or circuits can beused. Communication, or transfer, of data may be wired, wireless, or byany other means.

A “processor” may include any suitable hardware and/or software system,mechanism, or component that processes data, signals or otherinformation. A processor may include a system with a general-purposecentral processing unit, multiple processing units, dedicated circuitryfor achieving functionality, or other systems. Processing need not belimited to a geographic location, or have temporal limitations. Forexample, a processor may perform its functions in “real-time,”“offline,” in a “batch mode,” etc. Portions of processing may beperformed at different times and at different locations, by different(or the same) processing systems. A computer may be any processor incommunication with a memory. The memory may be any suitable datastorage, memory and/or non-transitory computer-readable storage medium,including electronic storage devices such as random-access memory (RAM),read-only memory (ROM), magnetic storage device (hard disk drive or thelike), flash, optical storage device (CD, DVD or the like), magnetic oroptical disk, or other tangible media suitable for storing instructions(e.g., program or software instructions) for execution by the processor.For example, a tangible medium such as a hardware storage device can beused to store the control logic, which can include executableinstructions. The instructions can also be contained in, and providedas, an electronic signal, for example in the form of software as aservice (SaaS) delivered from a server (e.g., a distributed systemand/or a cloud computing system).

It will also be appreciated that one or more of the elements depicted inthe drawings/figures can also be implemented in a more separated orintegrated manner, or even removed or rendered as inoperable in certaincases, as is useful in accordance with a particular application. It isalso within the spirit and scope to implement a program or code that canbe stored in a machine-readable medium to permit a computer to performany of the methods described above.

As used in the description herein and throughout the claims that follow,“a”, “an”, and “the” includes plural references unless the contextclearly dictates otherwise. Also, as used in the description herein andthroughout the claims that follow, the meaning of “in” includes “in” and“on” unless the context clearly dictates otherwise.

Thus, while particular embodiments have been described herein, latitudesof modification, various changes, and substitutions are intended in theforegoing disclosures, and it will be appreciated that in some instancessome features of particular embodiments will be employed without acorresponding use of other features without departing from the scope andspirit as set forth. Therefore, many modifications may be made to adapta particular situation or material to the essential scope and spirit.

1.-20. (canceled)
 21. A device comprising: circuitry configured todetermine a user profile; select a user interface (UI) pattern of one ormore UI patterns based on a situation, wherein the situation includesthe user profile; perform an operation based on a first behaviorpattern, wherein the first behavior pattern includes one or morepredetermined behaviors; receive one or more responses, wherein the oneor more responses are responsive to the one or more predeterminedbehaviors; modify at least one of the predetermined behaviors, whereinmodifying the at least one predetermined behavior results in a modifiedbehavior; and perform an operation based on a second behavior pattern,wherein the second behavior pattern includes the modified behavior. 22.The device of claim 21, wherein the modified behavior includes conveyingaffects to a user.
 23. The device of claim 21, wherein the at least onechange in one or more of the responses comprises a positive reaction ora negative reaction.
 24. The device of claim 21, wherein the circuitryis configured to perform the operation including: detecting anotification to be presented; and presenting the notification.
 25. Thedevice of claim 24, wherein the circuitry is configured to perform theoperation including: detecting when a commercial is being shown; andpresenting the notification during the commercial.
 26. The device ofclaim 24, wherein the circuitry is further configured to perform theoperation including presenting the notification based on a priority ofthe notification.
 27. The device of claim 24, wherein the circuitry isfurther configured to perform the operation including detecting thenotification to be presented based on a user preference.
 28. The deviceof claim 21, wherein the circuitry is configured to determine the userprofile using voice recognition.
 29. The device of claim 21, wherein thecircuitry is configured to determine the user profile using facialrecognition.
 30. The device of claim 21, wherein the circuitry isconfigured to access a library of different UI patterns.
 31. The deviceof claim 21, wherein the one or more predetermined behaviors includecommunicating by voice.
 32. The device of claim 31, wherein thecircuitry is configured to modify one or more voice characteristics ofthe voice, and the one or more voice characteristics are modified basedon one or more of tone, speed, and level of engagement, volume, andgender.
 33. The device of claim 21, further comprising a display. 34.The device of claim 21, further comprising a microphone.
 35. The deviceof claim 21, further comprising a camera.
 36. A non-transitorycomputer-readable storage medium with program instructions storedthereon, the program instructions when executed by one or moreprocessors are operable to perform operations comprising: determining auser profile: selecting a user interface (UI) pattern of the one or moreUI patterns based on a situation, wherein the situation includes theuser profile; performing an operation based on a first behavior pattern,wherein the first behavior pattern includes one or more predeterminedbehaviors; receiving one or more responses, wherein the one or moreresponses are responsive to the one or more predetermined behaviors;modifying at least one of the predetermined behaviors, wherein modifyingthe at least one predetermined behavior results in a modified behavior;and performing an operation based on a second behavior pattern, whereinthe second behavior pattern includes the modified behavior.
 37. A methodcomprising: determining a user profile; selecting a user interface (UI)pattern of the one or more UI patterns based on a situation, wherein thesituation includes the user profile; performing an operation based on afirst behavior pattern, wherein the first behavior pattern includes oneore more predetermined behaviors; receiving one or more responses,wherein the one or more responses are responsive to the one or morepredetermined behaviors; modifying at least one of the predeterminedbehaviors, wherein modifying the at least one predetermined behaviorresults in a modified behavior; and performing an operation based on asecond behavior pattern, wherein the second behavior pattern includesthe modified behavior.
 38. The method of claim 37, wherein the modifiedbehavior includes conveying affects to a user.
 39. The method of claim37, wherein the at least one change in one or more of the responsescomprises a positive reaction or a negative reaction.
 40. The method ofclaim 37, wherein the performing of the operation including: detecting anotification to be presented; and presenting the notification.